Integrated architecture and network for archiving, processing, association, distribution and display of media

ABSTRACT

A media management framework comprises an integrated architecture and online networking service for aggregating a user&#39;s various media files to enable a customized distribution of those media files. User media files are processed, archived, aggregated, and distributed for display in customized story streams. Additional media files are pulled from other sources, such as social media feeds and the public domain, to create a customized distribution and a comprehensive user experience centered on a user&#39;s media files based on specified user preferences. The customized distribution also includes modifying story streams based on learning of additional user preferences from continued user interaction and continuously grouping inference associations from one or more of activities, people, objects, times, dates, and locations.

FIELD OF THE INVENTION

The present invention relates to customized infrastructure forprocessing, aggregation, and distribution of media, tailored to a user'sspecific needs. Specifically, the present invention relates to anintegrated architecture and network that provides a single system ofreference with applications that enables users to store, manage anddistribute digital and digitized media such as photos, video, and audio.The present invention improves upon existing technological solutions bydevising a process which makes use of multiple processing paradigmsconfigured in specific machine implementations to enable advancements inthe customized aggregation, distribution, presentation, and storage ofuser media files. The present invention is provided as a software as aservice (SaaS) and is accessible through IP-based networks connected tothe Internet or private networks such as those in a home.

BACKGROUND OF THE INVENTION

In today's digitized world, media is being amassed at a nearlyexponential pace, as an ever-increasing number of portablecommunications and media devices empower individuals and organizationsto capture life's most precious moments at every turn. Media creation isnow easier than ever before, and because of this, the amount of mediabeing collected is now so overwhelming that filtering a highlightaccount of an event or story without considerable manual effort isuntenable. As media collections continue to grow, so does the effortthat must be made to keep up with conceptualizing these collections tofilter highlight accounts.

Devices with Internet and mobile telephony capability such as cell andsatellite phones, personal computers, tablets or other computingdevices, and digital picture, audio & video recording devices enableUsers to create media in high-quality formats with ease. These samedevices also enable Users to quickly accumulate large libraries of mediafiles, as media becomes increasingly easy to create.

This ease of media creation also presents the opportunity to create alarge number of media files and large media files in a very short periodof time. For example, an individual can capture multiple pictures insplit-second intervals—while also at the same time capturingvideo—guaranteeing that no sound or visual is missed. These largelibraries of media remain on the devices or are often transferred to oneor more devices for storage and processing. Many individuals havemultiple libraries of media residing on storage drives or computers thatare independent and fragmented from other large libraries of media on aUser's other storage devices. An individual user can have, for example,several hundred gigabytes of digital photos, video and audio on severaldevices and multiple computers. In many cases, media in such librariescan take up over half of a single computer's drive storage—and Usersoften store multiple copies of media archives, ultimately confusing andduplicating media in consolidated archives. Additionally, computers,tablets, cameras and phones rarely survive the lifetime of media, andare not ideal for long-term storage of media files. This leads manyUsers to frustrating ends as the cataloguing and consolidation of largelibraries takes time and rarely results in file structures similar tothe original file structure. The situation is compounded by the sheerquantity of media files that are growing and overwhelming to the Userand are a barrier to their enjoyment.

Social media and photo sharing sites provide an opportunity to sharecurrent digital media, but significantly lack the ability to storecomplete media archives and organize, distribute or share media fromsuch an archive in a personalized or customized manner. Meanwhile,native media management applications installed on computers oftenrequire the most advanced and available hard drive speeds, memory andprocessing power to function. This often leaves Users with older orlower end computers with few options to process media into displayformats.

BRIEF SUMMARY OF THE INVENTION

The present invention provides the ultimate single system of referencefor, and customized presentation of, digital and digitized media. Thepresent invention enables users to aggregate, archive and display mediasuch as photos, sound clips, video clips, music, and other media filesin customized “story” streams. This is accomplished using an intelligentand integrated architecture that creates audio/visual displays byprocessing media to apply one or more tags to media, and buildinferences, construct a set of inference sequences, and generate storystreams comprising this media based on the way users define experiencesand memories.

The present invention is embodied in one or more systems and methodsthat present a framework for combining digital media reference andinformation derived from and/or provided by users, digital media,recognition technology and proprietary algorithms to enliven large andstale media archives on external hard drives, mobile devices, tablets,current and old laptop and desktop computers, and any other suchdevices. In such a system and method, the framework enables users tosimply upload their digital and digitized media and provide answers toan interactive questionnaire. Within a short time, the systems andmethods of the present invention generate and deliver story streams forusers that are distributed to audio/visual display devices at theirdirection, in a predictive, dynamic, and automatic process.

Each such display device can therefore be configured to tell its own“fresh” story or multiple stories. The present invention generates storystreams that include photos and videos that are based on criteria suchas for example people within or not within the photos, the dates thephotos were taken, geo-location data, and objects within or not withinthe photos. Users can then select one or more story streams for displayon one or more audio and/or video displays or to share with users viaInternet links or other messaging mediums. For example, a display devicein the living room of a home can show family photos, whereas rooms forchildren may have a picture frame dedicated to each child that sleepsthere. In one embodiment of the invention, the display device maycontinue to tell a fresh story by dynamically varying the content toincorporate new media files as they are added to the system, either inreal-time or as directed by the user. Similarly, display devices can beupdated by dynamically varying the content to incorporate new mediafiles based on special dates like birthdays, anniversaries and holidays.

The “fresh” story is continuously generated, even in the absence of newmedia content being added. This is because a story stream is based onrules and inferences that, due to their relative nature, result indifferent media being filtered for display. Given that many people havehundreds of gigabytes of media, it is quite likely that the conceptbehind the story stream is a causing an ever-changing presentation. Forexample, a user may apply rules that “only present media that has notbeen displayed for five days” or “display media that are in sympathywith the weather”, so a cloudy day results in cloudy photos ormelancholy music. These kind of rules are therefore relative to themedia content, rather than absolute, which is often the case with othermedia presentations or hard-copy photo albums which are fixed by theirnature.

As noted above, individuals and organizations alike are able to amasshundreds of gigabytes of media files a year using a myriad of differentdevices. Such files may be in the form of digital media, analog media,or digitized media from analog or legacy material, such as photos thathave been scanned, and it is to be noted that this specificationcontemplates “media” to mean all of digital, analog, and digitized mediafiles. Regardless, without tools to manage this enormous collection ofmedia, it will remain nothing more than a static and unavailablearchive. The present invention enables users to unlock their mediaarchives and dynamically deliver them back with ease across anyavailable display medium in a customized manner.

The present invention is, according to one exemplary embodiment, a mediamanagement framework within which one or more of processing, archiving,association, distribution and display of media is performed. In anotheraspect thereof, the present invention is an online networking servicefor generating story streams representing a user's media that isprocessed, archived, associated, distributed and displayed using such anintegrated architecture. It is therefore one objective of the presentinvention to provide a system and method of managing large collectionsof user media files, and to deliver them in a customized format at theuser's direction. It is another objective of the present invention toprovide a system and method of aggregating a user's media files toenable this customized delivery of the media files. It is still anotherobjective of the present invention to provide an online service within adistributed computer infrastructure such as a cloud computingenvironment that forms at least part of an integrated architecture toperform the system and method of aggregating a user's media files toenable a customized distribution of those media files as above. It isyet another objective of the present invention to enable other types ofmedia to be aggregated from other sources, such as social media feedsand the public domain, to create a comprehensive user experienceinclusive of their media and publically available media from otheronline sources, and with customized attributes.

At the outset, several terms used throughout this specification aredefined as follows. A “media display mode” is defined as any system,such as a device or distribution channel, having video, audio, or dualaudio and video capabilities that is configured to receive or downloadmedia content. Each such system may include the ability to cache,download or receive streaming content for rendering on a display, andeach media display mode act as a distribution point for story streams.Such systems enable users of the present invention to display photos,video clips and other media on devices such as conventional televisions,HDTVs, computers, tablets, mobile phones, watches and other wearablessuch as headgear, digital picture frames, browsers, vehicle-baseddisplays and digital displays on appliances such as refrigerators, andto broadcast associated sound bites and music clips. This technology canintegrate with proprietary display mediums, or can integrate with thirdparty display mediums. Regardless, it is to be understood that anysystem, device or channel capable of or configured to receive ordownload media content may be utilized as a media display mode, and thepresent invention is therefore not to be limited by any particularsystem or device referred to herein.

Also, a “media tag” is an identification label for photos, video clips,sound bites and music that are used for sorting, categorizing, searchingand creating a story stream. Media tags are data points assigned to usermedia files to develop associations between them. Algorithms deployedwithin the present invention are arranged to automatically assign thesemedia tags based on user preferences, which are developed from arecognition analysis, extracted automatically from uploads of user mediaor from user interaction with the present invention. The presentinvention also contemplates one or more user interfaces that permitusers to manually add media tags to specific media items. Media tags ofinterest may therefore be inferred based on existing media, such thatthe present invention operates in the absence of any user preference orprofile. For example, as the present invention analyzes media files,certain conclusions may be drawn (such as a large amount of media onJuly 4th might indicate the user is American and therefore interested inother American holidays, such as Thanksgiving—and tag media andpreferences accordingly). A “story stream” is a collection of photos,video clips, sound bites, music and any other types of user media filesthat intelligently match specific media tag criteria, user preferencesand other specified criteria as further set forth herein.

The present invention associates places, times, events, people, andother information points using a combination of user information, mediatags, and proprietary algorithms to create a media deliverable in theform of story streams, with chapters that can be delivered to one ormore display channels or devices, as noted above. User archives aretherefore brought to life by generating these story streams, as well asguiding users through story stream creation to enable a more efficientdistribution of user media files. A story stream's format, and thechapters within it, are selectable by the user and deliverable to themedia display mode of choice. For example, some media, such as photos,may be delivered to a television in a family room, with selectedfavorite music files streaming with the story stream. Meanwhile, anotherchapter of the story stream may be selected and intelligently associatedand shared with one's parents in a display channel such as a digitalpicture frame in their home, such as family pictures from the 1980s.

One significant advancement over existing technological processes allowsnewly-taken photos to be immediately associated with a story stream, sothat the story stream is dynamically updated as user media is created.For example, when newly-taken photos are from a sporting event, thepresent invention identifies the sport, and the individuals in thephotos using a recognition analysis, and the newly-taken photos areimmediately delivered for display on selected media display modes.

The many benefits and advantages of such a media management frameworkbecome immediately apparent where one considers the massive volume ofmedia that is typically accumulated. For example, if a user were to take30,000 digital media files (roughly about 10 years of photos), andreview and tag each photo (taking only 30 seconds per photo), the userwould have to spend 2 hours a night for 125 days just to tag andorganize the information to produce an organized library. The user wouldthen have to spend 2 hours a month updating and tagging new photos. Thisdoes not take into account the numerous photos and videos received fromsocial media networks or from other connected users. After organizing,the user would need a robust media application to create presentationsof media based on criteria the user organized the media with.Independent of the user processing media into a presentation, theprocess of archiving and organizing media is therefore extremelytime-consuming. Also, over time, media will be passed on to next-of-kinand later generations that will use new and more advanced computingdevices, operating systems, and other software. For this reason, itmakes little sense to organize media on local devices that will beoutdated within a few years when media can survive hundreds of years.

Additionally, selecting media files to process and present requiresconsideration of how to edit, where it will display, and how to deliverthe media. For example, one short presentation of a dozen video clipsand a dozen photos would have 24 or more transition points that caneffectively use multiple sound and visual transitions selected by theuser. Such manual editing takes many hours. Once the media presentationis created, users must transfer the presentation or files throughstorage devices, intranet or internet network links, and also considerthe format of the media for the display device. The delivery of themedia to displays is also a very manual and time consuming process.Therefore, the options available to the user to process and presentmedia can be as time consuming as aggregating and organizing mediaarchives.

The media management framework of the present invention addresses suchissues by providing applications within the integrated architecture andnetworking service, together with storage and distribution paradigms, tocontinually leverage the latest distributed computing infrastructuretechnology, such as “cloud” computing services. With the presentinvention, users no longer have to spend hours organizing archives,sorting media for specific presentations, editing media display, orsearching for ways to convert media for display, or transferring mediaagain and again to the new computer or archive mediums, as this isprovided as a cloud-based service. The present invention provides safe,secure and redundant storage using current best practices and storagetechnologies. Further, because the media management framework utilizessuch cloud computing services, applications and interfaces used toaccess and process, the media can be continually updated to provideusers with access to powerful tools via web browsers. Additionally, userinterfaces and applications in the present invention use a combinationof intelligent information gathering to capture user information, andguide users through processes to upload, identify, organize, andassociate media files, as well as to set up, link and distribute mediato audio and/or video display devices.

Story streams in the present invention are, as noted above, associationsof media organized by one or more tags (e.g. dates, people, events,activities, objects, locations, landmarks, music, etc.) that may bethought of as “sequences” of media forming a story. A user may select astory about a single individual such as a daughter, add an activity suchas soccer, and then select an audio/video display such as a pictureframe in the daughter's room for streaming the story. The presentinvention processes the user's archive to generate a story stream of theuser's daughter, in this example of a soccer game, and includes music oraudio and streams the visual and audio to the display device in thedaughter's room.

Users can select different stories to play concurrently or sequentiallyon single and multiple displays. For example, a user may select onedisplay to show sequences of each family member in the family room whiledisplaying athletic and game events in the game room. Sequences may alsoinclude favorite music streams, and sound bites from personal recordingscan be integrated into the story stream. The present invention enablesusers to select stories to share and stream with other users andassociated individuals such as family. For example, a user can generatea story stream of a specific event and email a link to the streamingcontent to a friend, family or group who in turn can distribute thestreaming audio visual to their digital display devices. A story streamcan also work dynamically in an event or commercial setting wheredigital media is created and uploaded in near real-time, creating adynamically updated story stream generated from multiple users. Forexample, a user can create an event and distribute the link to multipleusers attending the event, such as a wedding. During the wedding, alllinked users can upload media from the event for immediate display in astory stream.

The present invention applies multiple methods to aggregate andassociate media. One such method associates information from metadata inthe media files such as the date and time taken and location,information from the user, and from recognition applications to identifyevents, objects, faces and locations, as well as from proprietaryalgorithms to filter and organize media archives. For example, whereusers upload new photos from a basketball game, the present inventionidentifies the sport and the individuals in the photos, and immediatelyassociates them with a sequence. The present invention then continuouslybuilds inferences from these media tags, and from user profileinformation, and applies one or more applications to constructsequences, or bubbles, of inferences. Finally, the present inventiondynamically updates and displays a tangible representation of theinference sequences as story streams as new media files are uploaded.

The single system of reference for media in the present invention alsooffers users significant additional benefits over existing technologicalprocesses. By hosting media files for users, present invention is ableto take what is a highly disorganized and disparate archive of files onmultiple devices, in multiple formats and with varying information, andprocess the archive to create associations for presentation of stories.The present invention further enables users to distribute and sharestory streams in ways unachievable with a static device-based mediaarchive.

These and other objects, embodiments, features and advantages of thepresent invention will become apparent from the following description ofthe embodiments, taken together with the accompanying figures, whichillustrate, by way of example, the principles of the present invention.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate several embodiments of theinvention and together with the description, serve to explain theprinciples of the invention.

FIG. 1 is a systemic diagram of components in a media managementframework according to the present invention; and

FIG. 2 is a block diagram of information flow and steps performed withina media management framework according to the present invention.

DETAILED DESCRIPTION OF THE INVENTION

In the following description of the present invention reference is madeto the exemplary embodiments illustrating the principles of the presentinvention and how it is practiced. Other embodiments will be utilized topractice the present invention and structural and functional changeswill be made thereto without departing from the scope of the presentinvention.

Introduction and Explanation of FIGS. 1 and 2

FIG. 1 is a diagram of various components within a media managementframework 100 according to the present invention. The media managementframework 100 is embodied in an integrated architecture and network thattogether provide an online service for archiving, processing,distributing, and displaying user media files that is predictive anddynamic. The media management framework is performed within one or moresystems and/or methods that includes several components, each of whichdefine distinct activities required to support managing a user's mediafiles and delivering customized streams of those files to the devices orchannels of choice.

FIG. 2 is a diagram of steps performed within the media managementframework 100 according to the present invention. The steps areperformed within several phases that include pre-processing phase 210involving collection of user media files and user preferences. Mediafiles are organized in a processing phase 220 which is configured toextract information, tag media files, build inferences, constructsequences of those inferences, modify the sequences based on learneduser preferences, and define one or more streams of sequences. Finally apost-processing phase 230 is configured to initiate the one or morestreams and deliver those to user-specified modes of delivery.

Referring to FIG. 1, the present invention may also be thought of ascomprising as a media initialization component, a media processingcomponent, a user interaction component, and a display managementcomponent. Together, these components embody the media managementframework 100 within the integrated architecture and network thatprovide an online service for archiving, processing, distributing, anddisplaying user media files 110.

The media initialization component comprises hardware and softwarecomponents specifically configured for intake, storage, tagging, andinferring associations of user media 110. All types of user media 110are ingested into, received by, or otherwise communicated to a medialibrary database 120 using one or more media import tools 122. The mediamanagement framework therefore performs initial pre-processing steps ofimporting media from users, and compiling a media library 124 comprisedof all of the user media files 110 provided by or associated with auser.

The user media files 110 may include many different types of files, frommany different sources. For example, user media files 110 may includecomputer-based files 111 such as those stored on user's desktop, laptop,or tablet computer, files 112 stored on a mobile device, whetherphone-enabled or otherwise, and cloud-based files 113 such as thosestored or maintained with an online service, for example Picasa®,Shutterfly®, or Flickr®. Other types of files include social media files114 (for example, files maintained via Facebook® or Instagram®), files115 provided by user contacts, and third party files 116 such as news ormapping services, material in the public domain, or content available bysubscription. Examples of such material may include stock photos of alandmark or city, or a satellite photo of a specific location availablefrom Google Maps.

The present invention compiles these files 110 in the database 120. Thedatabase 120 may comprise many different database components indisparate locations in many different formats, and therefore it is to beunderstood that a user's media library 124 may not be located in thesame physical storage medium. The database 120 may also store media tags126, which are created by one or more media tagging tools 130 that areconfigured to apply a plurality of analyses on user media files 110 thatinitially categorize each file 110. The media tagging tools 130 mayperform a data file analysis, and apply a recognition analysis, toidentify, and extract one or more characteristics of a media file 110,in addition to further quantification of information provided by theuser. The present invention therefore applies the one or more mediatagging tools 130 to a media file 110 in the media library 124, andstores the information extracted from the user media files 110 in thedatabase 120.

The data file analysis of the media tagging tools 130 interrogates usermedia files 110 to extract whatever information is stored within thefile itself. All files have basic information, such as creation date,size, etc. Media files have additional information stored within them,such as for example geo-position/location, exposure in the case ofphotographs, etc. The data file analysis performs the tasks of storingthe raw information (such as date taken, location, exposure), andanalyzing that information to ascertain data implicitly (Americanholiday event, lighting condition indicating a cloudy day, etc.)

A recognition analysis in the media tagging tools 130 extracts that rawinformation to identify recognizable elements, such as for example aphoto with a skyscraper, a video with a soccer ball, an audio clip withintense music. Other media tags 126 and metadata may also be inferredfrom this raw information.

The media tagging tools 130 are implemented in one or more processors ina computing environment encompassing the media management framework 100.The information extracted from user media files 110, in the form ofmedia tags 126, are output data that are provided as input data to theinferring association tools 150 described below. The inferringassociation tools 150 are one or more hardware components comprising atleast one processor specifically configured to analyze extractedinformation and generate inferences 142.

The media initialization component also comprises an inference database140, which is configured to store the inferences 142 generated from theextracted information in the tagged media files 110 by applying the oneor more inferring association tools 150. Inferences 142 are drawn fromthe user media 110 and tags 126 based on an inference analysis performedby the inferring association tools 150. An inference analysis is aprocess of looking at media tags 126 to determine whether various filesamong the user media files 110 can be grouped together for subsequentpresentation, as described further herein.

The user interaction component comprises hardware and softwarecomponents and at least one processor specifically configured to collectcharacteristics 161 representative of user preferences 162 which arestored in a user profile database 160, and apply this as input data togenerate a user profile 163 (also stored in the user profile database160). User preferences 162 are drawn from characteristics 161 providedby the user, for example via a graphical user interface configured toallow the user to interact with the media management framework 100. Theuser profile database 160 also stores user-provided media tags 164, inwhich the user selects and provides his or her own tags to categorizemedia files 110.

A user may also select a theme 166 via the graphical user interface. Atheme 166 may be any classification of media files 110 that is desiredfor presentation, such as a for example a birthday, a party, a vacation,or other event or common attribute that one or more media files 110include.

User preferences 162 are inferred from characteristics 161 that may beprovided either directly by the user, or inferred from the user's habitsor interests as indicated on social media platforms. For example, if auser uploads files that are all grouped together on a social mediaplatform such as Pinterest, the present invention may infer one or morepreferences based on characteristics according to which they are groupedtogether.

The inferring association tools 150 are also implemented in one or moreprocessors in a computing environment encompassing the media managementframework 100. The inferences 142, together with the user profile 163and user-provided tags 164, are output data that are provided as inputdata to the bubble session tools 170 described below. The bubble sessiontools 170 are one or more hardware components comprising at least oneprocessor specifically configured to process the inferences 142 andgenerate sequences of inferences 142.

The media database 120, the inference database 140, and the user profiledatabase 160 are coupled to a “bubble” session tool 170 within the mediaprocessing component of the present invention. The media processingcomponent comprises hardware and software components specificallyconfigured to organize sequences of inferences 142, which may be thoughtof as “bubbles”, sessions, or sequences of inferences related to usermedia 110. The media processing component also includes a story streamdefinition database 180, which includes components configured todetermine streams of media files based on the sequences of inferences142. The story stream definition database 180 communicates with one ormore stream generation tools 182 to initialize a stream for delivery toa user's specified display device or delivery channel 198. The storystream definition database 180 includes a database component formaintaining story definitions 188, and the story stream generation tools182 include at least one specifically configured processor that executesa software application for intelligently processing, filtering, andselecting story definitions 188 to generate a presentation comprisingthe user media files 110 that together tell the story the user wishes totell. The stream generation tools 182 are also implemented in one ormore processors in the media management framework 100. The sequences ofinferences 142, are output data that are provided as input data to thestream generation tools 182 to process the sequences of inferences 142and generate stream from those sequences. The stream generation tools182 one or more hardware components comprising at least one processorspecifically configured to process the sequences of inferences 142.

Together, the bubble session tool 170 and one or more stream generationtools 182 (together with the stream definition database 180) areresponsible for developing streams from sequences of inferences byaggregating media tags 126, inferences 142, themes 166, user preferences162 and user-provided media tags 166, display characteristics 196, andadditional stream rules or tags 184. Themes 166 may be stored in one ormore theme database collection 167.

The display management component comprises hardware and softwarecomponents specifically arranged to configure a stream for delivery anddisplay on a specified device, or over a specified delivery channel 198.The display management component includes a registered displays database190, a set of display management tools 192, and a live stream displaytool 194. The displays database 190 stores display characteristics 196,such as device internet protocol addresses.

The live stream display tool receives 194 instructions to distribute astream to a specified display device or delivery channel from the streamdefinition database 180 and associated set of stream generation tools182, and delivers the stream accordingly. A remote control application197 may also be included as part of the display management components inan overall system and method for performing the media managementframework 100.

Referring to FIG. 2, the pre-processing phase 210 includes the mediainitialization and user interaction components, and performs the stepsof importing 212 user media files 110, compiling 214 the media library124, enabling and managing 216 user interactions via, for example, agraphical user interface, and generating 218 a user profile 163 fromuser preferences 162 inferred from the characteristics 161 provided bythe user interaction.

The processing phase 220 includes the media processing component, andperforms the initial step of assigning media tags by extracting 221information from, and applying 222 the media tagging tools to, usermedia files 110 to perform an initial categorization. The processingphase 220 continues with the steps of building 223 inferences from themedia tags, constructing 224 sequences (or bubbles) of inferences 142,and applying user preferences and learned preferences based onadditional information and subsequent user interaction to modify 225 theinferences 142. The processing phase 220 concludes with the step ofdefining 226 one or more streams of these bubbles or sequences ofinferences 142. The display and delivery configuration phase 230 is apost-processing phase that includes the display management component,which the defined streams are configured 232 and prepared fordistribution, and delivery is initiated 234 to user-specified displaydevices or delivery channels 198.

While it is one embodiment of the present invention that all user mediafiles 110 are hosted and stored in the various database collections ofthe media management framework 100, it should be noted that the variousdatabase components of the present invention may each comprise manydifferent database components in disparate locations and in manydifferent formats within the computing environment, and therefore suchcomponents may not be located in the same physical storage medium.Accordingly, it is another embodiment of the present invention that themedia management framework 100 is configured to access and pull onlythose media files 110 from selected media sources authorized by the useror identified as related to user media files 110 (whether it be, forexample, the data base on his or her computer, mobile phone, laptop,specific social media accounts, online services, the hard drive on aspouse's computer or a cloud-based drive associated with a spouse, etc.)to compile a story stream 186. Therefore, the present invention may hostand store only selected user media files 110.

The processors configured in the media tagging tools 130, inferringassociation tools 150, the bubble session tool 170, and the userinteraction may include processors specifically configured to performdedicated functions attendant to generating media tags 126, inferences142, user preferences 162, sequences, additional user preferences,inferred preferences, and story streams 186. For example, globalpositioning system (GPS) receivers configured to analyze GPS signalstransmitted by mobile computing devices, tablet computers, or cameras(or GPS data embedded in file metadata) that transmit and upload usermedia files 110 may be included among these hardware components.Therefore, in one example of a specifically-configured processor orparticular machine implementation, the media management framework 100may include the capability to automatically identify user locations fromuser media files 110 that are uploaded, and therefore the data fileanalyses and recognition analyses applied may operate in conjunctionwith such GPS receivers to apply geo-location tags to such user mediafiles 110.

Many other specifically-configured processors and particular machineimplementations exist within the media management framework 100. Forexample, the recognition analyses performed herein are configured toidentify recognizable elements, such as for example a photo with askyscraper, a video with a soccer ball, an audio clip with intense musicas noted above. A sound file (for example an audio bitstream file, suchas a .wav file) that is uploaded among the user media files 110 may beautomatically applied to a processor that searches a web-based servicefor a match with a song title and a particular artist. Where the soundfile's metadata includes geo-positioning information, the processor mayinitiate a search to identify a public event, such as a concert, wherethe song was recorded by the user.

The present invention provides a comprehensive, end-to-end mediaexperience in an integrated architecture and online networking servicethat provides a single, cloud-based resource for aggregating andprocessing all of a user's different types of media, and for customizeddistribution of media as directed by the user. The architecture enablesphotos, video files, audio files, and other such media to be uploadedand stored, and also synchronizes all of a user's computing devices(such as desktop, laptop, and tablet computers, mobile phones, and othersuch mobile or wearable computing devices), social media accounts, andcalendars, together with cloud-based computing services. The presentinvention includes a virtual network concierge in a user profile toolthat creates a media profile for each user based at least in part on theuser's interaction with the graphical interface, and connects the user'smedia to the delivery channel of choice, such as a living room HDTV, ora digital picture frame in the office, kitchen or child's room.

The present invention provides users with a simple online registrationthat links and uploads user archives from their various media devicesinto a single system of reference to store, organize and distributedigital media. The present invention further synchronizes with devices,applications, social networks and other third-party digital mediaservices to gather media and information that may not reside inarchives, further enhancing a single aggregation point and sourcelocation for digital media. Registered users then provide profileinformation through a profile application process. This information isused to process, tag and organize a user's digital media.

The media processing component of the media management framework 100consolidates and categorizes all user-provided and third party providedmedia files 110 into a single system of reference. This includespersonal media, media accessible on the Internet, social media, mediafrom online services, files from friends, and other third party mediaaccessible to the User.

The media processing component includes the media import tools 122,which act as an interface with media archives and services that form auser's file storage ecosystem, whether they be personal desktops,laptops, tablet computers, phones, cameras, and third-party media andsocial networks, through APIs. The media import tools 122 are configuredto import media and other available information such as interests,music, photos, videos, sound bites and other media, from sourcesidentified by the user, from their various computers and other devices,as well as various public online sources. Imported media 110 is archivedby the media management framework 100 via the media import tools 122 andstored in the media library 124, and associated information is importedand used to populate the user profile 164 at least in part. The mediaimport tools 122 may also actively and continuously monitor thesesources for new media to be included in the media library 124.

The media management framework 100 includes the multiple tools describedherein to associate and categorize user media files 110, in the processof aggregating media, create and edit story streams 186, and distributethose story streams 186 to media display modes 198. Much of the mediagenerated today contains a wealth of information, such as the datetaken, the geo-location, people tagged in the images, and so on. Thevarious tools included within the media management framework 100 takethis information and combine and process it with other information toassist users with associating, categorizing and maintaining their mediaarchives. The present invention also contemplates applications thatenable users to convert or process older, non-digital media such asfilm, paper photographs, records, and video that are created without thebenefit of embedded information in metadata. The present invention istherefore designed to be a single system of reference for all media thatcan be uploaded and stored.

The media management framework 100 is also designed to enable advancedsearches of media archives. Because media files 110 are uploaded andstored on dedicated servers, proprietary processing techniques can beapplied to refine media libraries. These same processing techniquesenable users to search media archives based on subject or informationpoints that are not provided by the user or in metadata. One embodimentof the present invention provides a user interface that allows the userto search for specific videos, photos, sound bites and other types ofmedia files 110, based on specific search criteria. For example, a usermay search for all photos that contain only 2 specific individuals (e.g.two best friends from school), or may search for all photos that includea specific individual and a specific object (e.g. Joey with a soccerball). Similarly, users may also use the search capabilities of thepresent invention to exclude specific individuals, objects, or events.

The media tagging tools 130 of the media processing component mayinclude one or more applications responsible for associating specificdata points for each media file 110 using various processing techniques.The data points associated with each media file 110 are then used tofilter and categorize media files 110 into story streams 186. The datapoints represent one or more tags 126, and a reference for such tags 126is maintained in one or more tag reference database collections, and themedia tagging tools 130 continually process media files 110 to applytags 126 and associate files 110 in the media library 124 in conjunctionwith the one or more tag reference database collections. Theseapplications within the media tagging tools 130 also provide userinterface capabilities that allow users to customize and manually tagmedia files 110 with information such as people, objects, dates,locations, etc.

The media management framework 100 than applies inferring associationtools 150 to media files 110 that have been tagged with media tags 126.These tools 150 include one or more applications responsible forapplying an inference analysis to the media files 110 and buildinginferences 142 from the media tags that associate media files 110together. The inference analysis of the inferring association tools 150is applied to infer events and interests from raw information collectedin the data file analysis and recognition analysis in the media taggingtools 130. For example, raw information may be “lots of photos on July4th” and “lots of photos of two babies with two adults”—and theinference would be an American family that celebrates American holidays.These inferences 142 are stored in the inference database 140, and areused to construct inference sequences, or “bubbles,” in a bubble sessiontool 170.

The bubble session tool 170 includes one or more applicationsresponsible for generating these sequences, or bubbles, of inferences142. Inference sequences serve to aggregate associated media files 110together with themes 166 and user profile 164 data as a preliminary stepto generating story streams 186. Extending the example above, “lots ofphotos on July 4th” and “lots of photos at the end of November”, bothwith the same two adults and children involved, imply an American familycelebrating American holidays. This inference may then be connected withthemes that involve traditional American music, and apply borders withstars and stripes, etc. Together, the inferences 142 and sequencesthereof create the foundation for a story stream 186 that centers arounda family enjoying their American holidays.

The media management framework 100 associates information from mediatags 126 from users and their various personal computing and mobiledevices, from third party users of social media and the respectiveplatforms, from metadata, and using recognition software and proprietaryalgorithmic processes to generate customized story streams 186. Forexample, where a birthday event is the subject of a stream 186, thepresent invention may collect time and location from metadata associatedwith digital files, associate dates such as birthdays from users,identify individuals in photos and activities displayed therein fromsocial media and using recognition analytics, identify music at theparty based on algorithms and applications capable of identifyingpopular music at the time, and display the media on a device in the roomof the individual having the birthday. The present invention uses APIsto link to information from a user's social media pages, and informationfrom other programs such as iTunes®, SoundCloud® or Pandora®. Usingproprietary algorithms, the media management framework 100 associatesand catalogs all of this media and presents and recommends story streams186 based on the associated media. During a simple profile process, theuser is asked a series of basic questions, such as name, age,anniversaries, etc., that help to automatically generate initial storystreams 186 quickly and easily with names like “Birthday Photos”,“Family Vacations” or “College Days”. Based on user preferences 163,users or the media management framework 100 itself may assign storystreams 186 to connected media display modes or share with individualsor groups for streaming display. The result is near real-timegratification and consumption of user media files 110.

Advanced features may also be included, such as associating story streamgeneration to a calendar event, which dynamically enables the presentinvention to create story streams 186 for display before, during andafter an event, even at the location where it is taking place. Forexample, a user has a group of friends coming over for dinner. Thecalendar shows these individuals will be coming to dinner at the user'shouse—and the media management framework 100 dynamically creates a storystream 186 that contains media such as photos of the invitees, andstreams the media to a display device in the dining room during theevent. The present invention may include advanced modes that allow theuser to combine various rules and algorithms to generate complex andrich story streams 186 (e.g. my two children taken on any IndependenceDay or any photo with a U.S. Flag). Popular music can also be associatedwith these story streams 186, so that a popular song from the 1980splays along with the “College Days” photos from that period. Inaddition, data on a user's music preferences can be taken from a user'sprofile, the analysis of a user's iTunes® library, SoundCloud® orPandora® data, or other such system or application.

The present invention also provides Users with the ability to customizestory streams 186 with thematic and stylistic elements. The userinterface provides means for entry and integration of stylized headingsand other text within the story stream 186. The user interface of thepresent invention may also be configured to allow the user the option tospecify the date of the photo, sound bite, or video clip, in the displayof a story stream 186. The present invention also incorporatestransitions that enhance the display of the media. Transitions are audioand visual effects that are overlaid and/or inserted among the files orclips that are associated into a story stream 186. The media managementframework 100 uses algorithms and associated information to selectappropriate transitions and combine media with transitions to create afluid stream.

There are many available transition elements that are examples of thetransitions used, including but not limited to fade, zoom, fly in,sound, text, pictures and provider selected advertisements. The streamgeneration tools 182 incorporate transitions into the story streams 186to enhance the viewing and listening experience. Inserting transitionseliminates the very time-consuming tasks of editing media to generatedisplays. The breath of “transitions” that can be used is nearlylimitless, and the methods of incorporating transitions applied with themedia management framework 100 automates this transition editing andselecting task. The media management framework 100 associatestransitions that are appropriate for the content. For example, for anassociated media library of a wedding media, the present invention mayselect “church bells ringing” as audio as transition and overlay a“lace” foreground at the edges of the display to make the framed streamenhance the visual and audio display experience. In another example, thepresent invention may associate media of a soccer game and applytransitions that include audio clips of applause, “oohs and ahhs” aswell as visual transitions of a soccer ball overlay flying through thetransition.

In one embodiment, the present invention may identify unique informationfrom a person's mobile device within a specified distance from a displaydevice which identifies such person, and thereby displays photographs,videos, sound bites or other media, creates a story stream 186, oraugments or modifies an existing story stream 186, to include suchperson or other data or displays which the user has specified should bedisplayed when such user is within the defined area. In anotherembodiment, the media management framework 100 may also ask the owner ofthe network and display(s) to invite the user to share a story stream186 over the network to a designated display or displays.

The user experience in the present invention is designed to be simple.Online registration occurs through a process that uploads and linksmedia archives from multiple devices and stores it in its current formator a converted format. After registration, the user interacts with thevirtual network concierge, which provides a guided “wizard” throughwhich the user answers a series of questions to create a personalizedprofile. The virtual network concierge may also be configured to provideinstruction that helps users input information and connect with theuser's audio/video devices, locations, individuals and groups such asliving room HDTVs, a digital picture frames, web pages, and devices anddelivery channels associated with family and friends. As user media isprocessed, the present invention may generate and deliver an index and arecommended listing of story streams 186 that can be used to deliver toselected display devices.

The present invention contemplates that many kinds of interfaces withUsers are possible. For example, one or more web page may be utilized,as well as applications resident on a “smart” mobile phone or other suchmobile device (for example, a tablet computer), to associate displaydevices with a user's account. Such an application may also be used totake photos for direct import into the media library 124 associated witha user.

Mobile applications may also be used to delete photos and other filesbeing shown on a display 198, using the phone or other such mobiledevice. Such an application and its associated device may also be usedto express preferences, such as a likes or dislikes, when a file isrendered on the display device 198. Additionally, a mobile applicationsmay also allow for uploading and tagging a photo or video to a phone orother mobile device as it is displayed on a third-party display.

It is contemplated that the present invention may also operate withoutparticipation of the user in the registration process so that the mediamanagement framework 100 works with minimal user input. For example,where a hardware device starts the process of analyzing and tagging usermedia files (such as a USB/HDMI FOB device which is designed to begin anapplication that identifies and collects media files 110 on alocally-connected network or hardware), then that device represents theuser and de facto user registration, without necessarily requiring usersto identify themselves.

As noted above, the user interaction component of the media managementframework 100 includes one or more tools 161 that build and maintain aprofile 164 about the user, including user preferences 163, and otherinterests of and information about the user. User profiles 164 may beedited and updated, and administrative privileges may be granted by theuser profile tool 161 to allow users access to their media archives orprovide access to other users. The present invention contemplates thatusers may have multiple user access to single and multiple accountsbased on requirements to share access to media archives among familymembers and other user groups. The present invention also gathers andassociates information with each user profile 164 based on the user datato enrich media association and processing of story streams 186.

The user profile tool 161 may include one or more applicationsresponsible for gathering information from the user, using variousinquiry methods. This may include interactive questioning using audio,voice recognition, text display and online forms to survey users forinformation that enables the media management framework 100 to associateand aggregate user media files 110 into story streams 186. Initially,users may be queried with survey questions about various interests andhobbies. Such surveys may be dynamic, such that each follow-up questionmay change based upon the previous response (e.g. responding positivelyto a question about sports, the user is then asked which sports they aremost interested in). Such surveys are intended to be fun and engagingfor the user, but also effective in gaining insight into userpreferences 163.

In addition, the user profile tool 161 imports information such asinterests and hobbies from any social media site or account that theuser has linked through APIs developed with such external informationsources. The user profile tool 161 may also pull information from publicsources based on the user profile 164 or on other factors. The userprofile tool 161 may also pull information about music and otherpreferences from iTunes® libraries, SoundCloud® accounts, Pandora® datafiles, or any other such service or site associated with a user. Thepresent invention may also survey users at future intervals to updateuser profiles 164 and either confirm information validity.

As a user provides information to the media management framework 100,the user profile applications of the user profile tool 161 populate oneor more database collections used for processing, associating andaggregating the user media files 110. For example, metadata providesinformation such as date and location, but user-provided information mayprovide data on specific events or activities such as birthdays,anniversaries or activities such as baseball that are stored asuser-provided media tags 165. The present invention associates datesfrom metadata with this user-provided media tag 165 information (such asa birthday) and where possible uses recognition technology to identifyactivities in a media file 110. This enables the media managementframework 100 to associate media files 110 from times and activitiesthat may have occurred over multiple years. The user profile tool 161and its applications therefore act as a filter for media files 110 andprovide critical information to enable story stream generation.

The present invention contemplates that user media files may bedistributed, shared, and/or delivered to, many different types ofdevices, channels, and modes as noted throughout. One embodiment of theinvention includes a process of distributing and delivering storystreams 186 over networks for display in formats compatible with mostthird party digital displays. Examples of such displays include digitalpicture frames, digital monitors, TVs, personal computers, mobiledevices and other hardware, including mainstream devices such as AppleTV or Google Chromecast®, and wearable computing devices, such asheadgear/headsets such electronic eyeglasses/eyewear and virtual oraugmented reality headsets for use in video games, helmets,wristwatches, wristwatch computers, hearing aids and audio devices. Inanother embodiment, the present invention includes a process todistribute and deliver story streams 186 to displays specificallydesigned to receive media generated over a specific network. In thisembodiment, displays may each contain chips, bar codes or applicationsthat enable users of the present invention to easily identify, registerand connect with the device over the specific network. The presentinvention also contemplates, in one or more additional embodiments,distribution to devices that enable users to change story streams 186dynamically, much like one might change a channel on a television with aremote or select a different radio station.

Each display device may also be identified and provided with a labelthat can be further customized by the user using the graphical userinterface, such as for “Family Room”, “Johnny's Room”, “CollegeMemories”, “Facebook Photos”, etc. Users then can assign story streams186 to displays as well as specify the timing and/or sequence that oneor more story streams 186 may display on devices. Each media deviceconnected to the present invention then receives streaming audio/videoof user story streams 186 from the user's archive or other story streams186 that have been shared. The present invention constantly processesand updates a user's information and media associations to improve storystreams 186 and include media from the past, as well as the present.

The display management component and stream distribution phase 240include, as noted above, one or more display management tools 192 and alive display tool 194. These tools may also include one or moreapplications responsible for consolidating and categorizing alluser-provided and third party provided media into a single system ofreference for distribution as a story stream 186. The registereddisplays database 190 maintains the display characteristics 196 of alldisplay units and types that are available for displaying media in storystreams 186, such as user-specified computing devices, phones, tablets,televisions, picture frames, and wearable computing devices, etc. Thedisplay management tools 192 and live display tool 194 use the displaycharacteristics 196 stored in the registered displays database 190, forexample, to determine the appropriate output format of the story stream186 for a display type, such as the resolution and bit-rate, etc.

The stream distribution phase 240 may also include the remote controlapplication 197, which is a component responsible for managing theremote control function of the media management framework 100, inconjunction with the display management tools 192, live stream displaytool 194, and display device or delivery channel 198. The remote controlapplication 197 includes one or more remote control management toolsthat consolidate and categorize all remote devices into a single systemof reference. This includes personal computers, laptops, smartphones,tablets, phablets, and other third party hardware devices or softwareapplications that may act as a remote control. A remote controlregistration tool allows users to register control functionality anddevices, and maintains all remote controls that are available forcontrolling the media displayed in story streams 186 (such as playbackcontrol, editing and deleting media, etc.) as well as ranking mediacurrently displayed (e.g. thumbs up or thumbs down function) to causeeffect in future media content displayed by influencing the algorithmsused in the story stream definition process. Remote controlregistrations are saved to a remote control database, and each remotecontrol is classified by a remote type which determines interactioncapabilities with a display unit.

The remote control application 197 also includes tools that enable theuser or the viewer to affect the story stream display experience bycontrolling the playback via typical controls (such as pause, rewind,forward-wind, speed-up, slow-down, volume change, mute, etc.) as well asinfluencing the rules used for story stream generation (such as rankingmedia currently displayed, via a thumbs up/down or 5-star rankingparadigm). One example of remote control functionality in the presentinvention includes enabling media from other story streams 186, or evenfrom other contacts or associates that have shared their media librariesor story streams 186, to be pulled into a story stream 186 being viewed.Accordingly, the remote control application 197 is capable ofcommunicating with the story stream generator and database 180 to modifystory streams 186. The modifications provided via the remote controlapplication 197 may also be considered as continued user interaction andare stored within the present invention to modify user preferences 163as part of the process of learning additional user preferences.

The stream generation tools 182 include one or more applications thatanalyze and compare tags between the user profile 164 and media files110 available to the user in order to create a story definition 188.Story definitions 188 are stored in a stream definition database 180 andare used to select media 110 and transitions for rendering with mediadevice modes. The stream generation tools 182 also define story streams186 that need not depend directly on user input, although one aspect ofthis process is to enable users to verify the resulting story stream 186and adjust the processes, algorithms and operational rules the mediamanagement framework 100 uses to organize, edit and display the storystream 186. The present invention applies these processes, algorithmsand operational rules along with information derived from the userprofile 164 to associate and filter the user's available media. Thestream generation tools 182 minimize, and may even eliminate, the needfor the user to review and select digital media for any given storystream 186. Regardless, the present invention may also provide advancedlevels of operation that enables users to change or influence thecreation of a story stream 186 directly. The stream generation tools 182are configured to learn user preferences 163, and as the user interactswith the present invention and/or manually refines completed storystreams 186, these applications remember nuances such as media deletedfrom story streams 186 and the arrangement, time interval, and displaypreferences the user applies most often, as well as continuallymonitoring user interests that may be determined from interfacing withsocial media networks, etc. In this manner, the stream generation tools182 are able to “learn” additional user preferences 163 and associationsof inferences groupings to modify sequences of inferences 142 and createadditional stream rules or tags 184 that are then used to adjust storystreams 186.

Learning user preferences 163 and associations of inference groupings,and modification of sequences of inferences 142, may occur any time theuser interacts with the media management framework 100, where it ispossible to infer something about their preferences in general as wellas specific to a story stream 186. For example, if a user selects the“pause” button on a remote control enough times when a certain person isinvolved in the photo, the present invention infers that the person inquestion is of greater value than previously determined (if at all).Also, the manner in which the user interacts with the media managementframework 100 may be analyzed differently depending on which userinterface is being used and for what purposes (e.g. viewing an existingstory stream 186, versus modifying the rules for a new story stream186).

User preferences 163, and the user profile 164, may be weighted asfurther user interactions are experienced. Therefore, the processing oflearning in the present invention and modifying inferences 142therefrom, is improved by determining what users prefer as story streams186 are being generated. Weights may be applied in many differentmanners, depending on other factors extracted from data file andrecognition analyses, and from the characteristics identified by theuser.

One machine implementation of the learning of user preferences 163includes one or more artificial intelligence techniques designed tomodel user preferences 163. This may include one or more logiccomponents designed to improve over time due by learning as new dataabout the user and extracted from the media files 110 is accumulatedwithin the media management framework 100. The logic components mayperform “fuzzy” processing techniques that apply approximations based onthe user interaction and data extracted from the media files 110.

The display management tools 192 and live stream display tool 194include, as noted above, one or more applications that are responsiblefor assigning story streams 186 to media display modes 198, or to beshared with other users. The one or more applications in a display adminapplication which provides users with the ability to set up and connectwith display devices, assign names and categories to display devices,and select story streams 186 to display on those devices at variousintervals and sequences. The media management framework 100 may alsoinclude an application which processes and associates user media files110 into an audio/video stream or file designed for optimal display onthe targeted media display mode 198, and also distributes the assignedstory streams 186 to assigned media devices 198. Such an applicationcontinually checks with the stream generation tools 182 for updates tostory streams 186 assigned to media display devices 198, such thatchanges to the rules or new media files 110 and related associations canbe added to story streams 186 on an on-going basis. This results in adynamic display on the selected media display mode 198, and therefore itis always in flux, more engaging, and likely to continue to surprise theviewer.

Multiple story streams 186 may be associated with one or more mediadisplay devices 198 (such as picture frames, personal computers,television screens, etc.) such that only the media 110 that correspondsto those story streams 186 are displayed on the appropriate displaydevice 198. For example, a family room may have one display device 198that shows the “Family Story”, whereas each child's room has a displaydevice 198 dedicated to their own photos respectively; and the study mayhave a display device 198 dedicated to the “College Days”. An olderfamily member, for example a grandmother, may also have a display device198 that includes a story stream 186 of all her grandchildren based onshared user accounts throughout her family.

The live stream display tool 194 therefore is responsible for preparinga story stream 186 for presentation on a media display device 198.Taking the story stream 186 defined by the output instruction fromstream generation tools 182, the live stream display tool 194 pullsmedia files from the media library 124 and applies one or more themes166 from the themes database 167. The live story display tool 194 alsoanalyzes rules from the “bubble” session tool 170, media tags 126,user-provided media tags 165, and information in the user profile 164.The live story display tool 194 also pulls display characteristics fromthe registered displays database 190, and any information from theremote control application 197. In this manner, a sequence of inferencesin a story stream 186 is configured based on the selected display modes198, and initiated for distribution thereto.

It is to be understood that many embodiments are possible and are withinthe scope of the present invention. For example, user credentials may beapplied to an apparatus that accesses the media management framework 100from a remote device. In such an example, a user may have credentialsassociated with an apparatus such as a USB dongle, and can insert suchapparatus in a display device 198 such as television when visiting afriend's home to display story streams 186 on the display device 198. Insuch an example, the story stream 186 would not be accessible by theowner of the display device 198 once the credentialed apparatus isremoved.

In another embodiment, a user may have the ability, using a mobile phoneor other device, to select a photo when viewing story streams 186 onsomeone else's display device 198 for delivery to himself or herself. Insuch an example, if a wireless network (such as Wi-Fi) can identify auser in another person's home, then story streams 186 (and by extension,media files 110) can be delivery to that user. Users may also be able toidentify bulk files or percentages of files to be delivered, such as forexample “I want all of Nick's photos from Peter's wedding.” Users mayalso be able to assign links or IP addresses of display devices 198 toother users, and those users can then send the files 110 (such as photostaken at a wedding) directly from the other user to the display devices198.

In another embodiment, an apparatus such as a USB flash or jump drive,or key fob, which is insertable into a computing device such as a laptopor desktop, may include software which automatically installs on thecomputing device for configuring access to the media managementframework 100. Such software allows a user to sign up and create anaccount, and enables access to local photos on a hard drive within thecomputing device. Such software may also requests permission to accessto social media accounts affiliated with the user. Therefore, networkaccess for the present invention may be configured on an apparatus thatis provided directly to users for installation on their personaldevices.

Users may also be able to take such an apparatus and insert into a localdevice such as TV screen, for example using an HDMI port. The apparatusconfigures an application to operate on the local device. The apparatusmay include credentials which allow the user to access his or heraccount, and access their media library 124 from the local device. Theapparatus may also include software for wireless communication withother computing devices and for accessing social media accounts.

Users may further be provided with a “freeze” option which allows themto capture dynamic portions of a story stream and carry out tasks suchas burning them to a disk, saving them to a USB drive, or sharing themwith other users, such as via social media accounts.

As noted above, it is contemplated that the systems and methodscomprising the media management framework 100 may be implemented usingdistributed computing infrastructure technologies such as “cloud”computing services. However, it is to be understood that the integratedarchitecture and online networking service according to the presentinvention may be further implemented in many different computingenvironments generally. For example, they may be implemented inconjunction with one or more special purpose computers, programmedmicroprocessors or microcontrollers and peripheral integrated circuitelement(s), an ASIC or other integrated circuits, digital signalprocessor(s), electronic or logic circuitry such as discrete elementcircuits, programmable logic devices or gate arrays such as a PLD, PLA,FPGA, PAL, and any comparable means. In general, any means ofimplementing the systems and method illustrated herein can be used toimplement the various aspects of the present invention. Exemplaryhardware that may be utilized in one or more embodiments or aspects ofthe present invention includes computers, handheld devices, telephones(e.g., cellular, Internet enabled, digital, analog, hybrids, andothers), and other such hardware. Some of these devices includeprocessors (e.g., a single or multiple microprocessors), memory,nonvolatile storage, input devices, and output devices. Furthermore,alternative software implementations including, but not limited to,distributed processing, parallel processing, or virtual machineprocessing can also be configured to perform the systems and methodsdescribed herein.

The systems and methods of the present invention may also be partiallyimplemented in software that can be stored on a storage medium, executedon programmed general-purpose computer with the cooperation of acontroller and memory, a special purpose computer, a microprocessor, orthe like. In these instances, the systems and methods of this inventioncan be implemented as a program embedded on personal computer such as anapplet, JAVA® or CGI script, as a resource residing on a server orcomputer workstation, as a routine embedded in a dedicated measurementsystem, system component, or the like. The system can also beimplemented by physically incorporating the system and/or method into asoftware and/or hardware system.

Additionally, the data processing functions disclosed herein may beperformed by one or more program instructions stored in or executed bysuch memory, and further may be performed by one or more modulesconfigured to carry out those program instructions. Modules are intendedto refer to any known or later developed hardware, software, firmware,artificial intelligence, fuzzy logic, expert system or combination ofhardware and software that is capable of performing the data processingfunctionality described herein.

The foregoing descriptions of embodiments of the present invention havebeen presented for the purposes of illustration and description. It isnot intended to be exhaustive or to limit the invention to the preciseforms disclosed. Accordingly, many alterations, modifications andvariations are possible in light of the above teachings, may be made bythose having ordinary skill in the art without departing from the spiritand scope of the invention. It is therefore intended that the scope ofthe invention be limited not by this detailed description. For example,notwithstanding the fact that the elements of a claim are set forthbelow in a certain combination, it must be expressly understood that theinvention includes other combinations of fewer, more or differentelements, which are disclosed in above even when not initially claimedin such combinations.

The words used in this specification to describe the invention and itsvarious embodiments are to be understood not only in the sense of theircommonly defined meanings, but to include by special definition in thisspecification structure, material or acts beyond the scope of thecommonly defined meanings. Thus if an element can be understood in thecontext of this specification as including more than one meaning, thenits use in a claim must be understood as being generic to all possiblemeanings supported by the specification and by the word itself.

The definitions of the words or elements of the following claims are,therefore, defined in this specification to include not only thecombination of elements which are literally set forth, but allequivalent structure, material or acts for performing substantially thesame function in substantially the same way to obtain substantially thesame result. In this sense it is therefore contemplated that anequivalent substitution of two or more elements may be made for any oneof the elements in the claims below or that a single element may besubstituted for two or more elements in a claim. Although elements maybe described above as acting in certain combinations and even initiallyclaimed as such, it is to be expressly understood that one or moreelements from a claimed combination can in some cases be excised fromthe combination and that the claimed combination may be directed to asubcombination or variation of a subcombination.

Insubstantial changes from the claimed subject matter as viewed by aperson with ordinary skill in the art, now known or later devised, areexpressly contemplated as being equivalently within the scope of theclaims. Therefore, obvious substitutions now or later known to one withordinary skill in the art are defined to be within the scope of thedefined elements.

The claims are thus to be understood to include what is specificallyillustrated and described above, what is conceptually equivalent, whatcan be obviously substituted and also what essentially incorporates theessential idea of the invention.

1. A method of user-directed production and distribution of content inarchived media files comprising: within a computing environmentcomprised of at least one computer processor, and at least onecomputer-readable storage medium operably coupled to the at least onecomputer processor, the at least one computer processor operable toexecute a plurality of program instructions to perform the steps of:archiving a plurality of user media files provided by or at thedirection of a user in a disparate user media library, and continuallyupdating the disparate user media library by designating additionalmedia files provided by the user; creating a user profile from rulesthat are developed from user-specified characteristics identified from,and continually updated by, at least one of user interaction via aninterface to collect user-provided preferences, and inferred userpreferences collected from information in the plurality of user mediafiles as the additional media files are designated, so that the userframes content for delivery in a dynamic sequence stream of theplurality of media files by influencing the rules to exert control overarchiving, production, and distribution of the content in the pluralityof media files; aggregating the plurality of user media files based onthe user profile and the continually updated rules to create a real-timeinteractive index of the disparate user media library to adaptivelyrelate content in the aggregated plurality of user media files for auser-controlled production and distribution of the content over one ormore devices designated by credentials assigned by the user in aspecifically-configured processor that performs one or more stepsincluding: extracting data from each user media file in a data fileanalysis performed in response to one or more of an import of theplurality of user media files or a reference to the plurality of usermedia files, identifying one or more of activities, people, objects,times, dates, and locations within each user media file in a recognitionanalysis applied to the plurality of user media files, assigning one ormore media tags to the plurality of user media files based on the userprofile and the continually updated rules, the data extracted from eachuser media file, and the data from the recognition analysis identifyingactivities, people, objects, times, dates, and locations identifiedwithin each user media file, building a plurality of inferences from theone or more media tags by associating specific data points to each usermedia file, constructing a set of sequences from the plurality ofinferences by associating inference groupings based on the specific datapoints, the user profile, and the continually updated rules, andmodifying the set of sequences with additional user preferences learnedby the specifically-configured processor based on a dynamic update ofthe user profile and the continually updated rules from one or more ofcontinued user interaction and data extracted from the recognitionanalysis and additional user media files; associating theadaptively-related content within the dynamic sequence stream that iscomprised of archived media files and continually modified in real-timeas additional media files are provided, and based on the continuallyupdated rules and interaction by a recipient of the dynamic sequencestream associated with the one or more devices by a stream definitionprocessor specifically arranged to 1) assign the adaptively-relatedcontent to at least one specific device in the one or more devicesdesignated by the user or to a specific location of a device in the oneor more devices designated by the user, 2) initiate the dynamic sequencestream for the user-controlled distribution of content to the one ormore devices designated by the credentials assigned by a user andaffiliated with the recipient, and 3) update the adaptively-relatedcontent based on the user-specified characteristics and the interactionby the recipient to dynamically modify the sequence stream in real time;and distributing the dynamic sequence stream to the one or more devicesdesignated by the user so that the adaptively-related content isdelivered for a private, varying display of the content under directionof the user.
 2. The method of claim 1, further comprising identifyingadditional data for generating one or more additional media tags and forgenerating updated dynamic sequence streams by continuously associatingthe inference groupings from the additional user preferences and therecognition analysis to modify the set of sequences.
 3. The method ofclaim 2, further comprising continuously applying an updated set ofrules developed from the user profile to perform the continuouslyassociating the inference groupings from the additional userpreferences.
 4. The method of claim 1, further comprising identifyingthe plurality of user media files from one or more of user'scomputer-based files, a user's mobile device-based files, and a user'saccount with an online file storage service, wherein the identifying theplurality of user media files occurs from one or both of importing usermedia files or referencing external media files.
 5. The method of claim4, further comprising importing related media files from at least onethird party source based on at least one of the user profile, the datainformation extracted from the plurality of user media files, theuser-provided preferences, and the inferred preferences.
 6. The methodof claim 5, wherein the one or more third party sources include usersocial media accounts, user contacts, external servers, and web sourcesthat include one or more of Internet-based services, information mediaresources, and other networked services.
 7. A system of user-directedproduction and distribution of content in archived media filescomprising: a computing environment including at least onenon-transitory computer-readable storage medium having programinstructions stored therein and at least one computer processor operableto execute the program instructions to execute a plurality of dataprocessing modules, the plurality of data processing modules including:a media import module embodied in a processor specifically configured toingest a plurality of user media files from one or more of the user'scomputer-based files, the user's mobile device-based files, and theuser's account with an online file storage service, and from one or morethird party sources; a media archive module embodied in a processorspecifically configured to archive the plurality of user media filesprovided by or at the direction of the user in a disparate user medialibrary; a profile generation module embodied in a processorspecifically configured to create a user profile from user-specifiedcharacteristics identified from one or more of user interaction via agraphical user interface to collect user-provided preferences andinferred user preferences collected from information in the plurality ofuser media files; one or more modules embodied in at least one processorspecifically configured to associate content in the plurality of usermedia files with one or more media tags based on data extracted fromeach user media file and on the user profile developed from theuser-provided preferences and the inferred user preferences, compile aplurality of inferences from the one or more media tags by associatingspecific data points to each user media file and associating inferencegroupings based on the specific data points and the user profile toadaptively relate the content in the plurality of user media files for auser-controlled production and distribution of the content over one ormore devices designated by the user, learn additional associations ofinference groupings from at least one of continued user interaction andcontinued ingest of user media files to continuously modify a set ofsequences from the associations of inference groupings from additionaluser preferences and additional data extracted from the continued ingestof user media files, and define one or more dynamic sequence streamscomprised of the adaptively-related content from the modified inferencesdeveloped from the additional associations of the inference groupingsand associate the one or more dynamic sequence streams with theadaptively-related content to distribute a private, varying productionof the adaptively-related content to the one or more devices underdirection of the user, so that the adaptively-related content isassigned to at least one specific device in the one or more devicesdesignated by the user or to a specific location of a device in the oneor more devices designated by the user; and a stream delivery moduleembodied in a processor specifically configured to initiate delivery ofthe private, varying production of the adaptively-related content fordistribution to one or more user-designated devices.
 8. The system ofclaim 7, wherein the one or more modules are specifically configured toprofile third-party information from third party media files similar toa user's media files and applying the profile of third-party informationto further define the one or more dynamic sequence streams.
 9. Thesystem of claim 7, wherein the one or more third party sources includeuser social media accounts, user contacts, external servers, and websources that include one or more of Internet-based services, informationmedia resources, and other networked services.
 10. The system of claim7, wherein the one or more modules embodied in at least one processingspecifically configured to apply a data file analysis to identify filemetadata.
 11. The system of claim 10, wherein the one or more modulesembodied in at least one processor is specifically configured to apply arecognition analysis to identify one or more of activities, people,objects, times, dates, and locations within each user media file. 12.The system of claim 11, wherein the at least one processor includes aglobal positioning system receiver to identify a location.
 13. Thesystem of claim 7, wherein the one or more modules embodied in at leastone processor is specifically configured to construct a set of sequencesfrom the plurality of inferences by associating inference sequencesbased on the user profile.
 14. The system of claim 7, wherein the one ormore modules embodied in at least one processor is specificallyconfigured to modify the set of sequences from additional attributesidentified in the one or more additional media tags.
 15. The system ofclaim 7, wherein the one or more user-designated devices is aninternet-enabled display device.
 16. The system of claim 15, wherein theinternet-enabled display device is one or more of a television, acomputer, a mobile telephony device, a picture frame, or a networkeddevice configured to receive data over a network.
 17. A method ofuser-directed production and distribution of content in archived mediafiles, comprising: within a computing environment comprised of at leastone computer processor and at least one computer-readable storage mediumoperably coupled to the at least one computer processor and havingprogram instructions stored therein, the at least one computer processorbeing operable to execute the program instructions to perform the stepsof: associating content in a plurality of user media files with one ormore media tags based on data extracted from each user media file and ona user profile based on user-specified characteristics developed fromone or more of user interaction via a graphical user interface toidentify user-provided preferences and inferred user preferencescollected from the information in the user media files, the plurality ofuser media files provided by or at the direction of a user for archivingin a disparate user media library; compiling a plurality of inferencesfrom the one or more media tags by associating specific data points toeach user media file and associating inference groupings based on thespecific data points and the user profile to adaptively relate thecontent in the plurality of user media files for a user-controlledproduction and distribution of the content over one or more devicesdesignated by the user; learning additional associations of inferencegroupings from on at least one of continued user interaction andcontinued ingest of user media files to continuously modify a set ofsequences from the associations of inference groupings from additionaluser preferences and additional data extracted from the continued ingestof user media files; and defining one or more dynamic sequence streamscomprised of the adaptively-related content from the inferencesdeveloped from the additional user preferences, and the additionalassociations of the inference groupings, and associating the one or moredynamic sequence streams with the adaptively-related content todistribute a private, varying production of the adaptively-relatedcontent to the one or more devices under direction of the user, whereinthe adaptively-related content is assigned to a specific device in theone or more devices designated by the user, or to a specific location ofa device in the one or more devices designated by the user.
 18. Themethod of claim 17, further comprising creating the user profile fromthe user-specified characteristics identified from the one or more ofuser interaction via a graphical user interface to collect user-providedpreferences and inferred user preferences collected from information inthe plurality of user media files and updating the user profile as usermedia files are continually ingested.
 19. The method of claim 17,further comprising extracting information from the plurality of usermedia files by applying a data file analysis to at least identify filemetadata, and by applying a recognition analysis to identify one or moreof activities, people, objects, times, dates, and locations within eachuser media file.
 20. The method of claim 17, further comprisingconstructing a set of sequences from the plurality of inferences byassociating inference groupings based on the user profile.
 21. Themethod of claim 17, further comprising modifying the plurality ofinferences from additional attributes identified in the one or moreadditional media tags.
 22. The method of claim 17, further comprisinginitiating delivery of the one or more dynamic sequence streams fordistribution to one or more devices designated by the user.
 23. Themethod of claim 17, further comprising creating a profile of third-partyinformation from third party media files similar to a user's media filesand applying the profile of third-party information to further definethe one or more dynamic sequence streams.